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DETAILED ACTION 



1. The amendment filed June 22, 2007 is entered and claims 1-22 and 27-30 are 
pending. 

Response to Arguments 

2. Applicant's arguments with respect to claims1-22 and 27-30 have been 
considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 (JSC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which fomris the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-11, 13-21 are rejected under 35 U.S.C. 102(b) as being unpatentable 
over US Patent No. 5,404,458 by Zetts. 

Regarding claim 1 , Zetts teaches an opened software application window Fig.3 
(100) and the action bar 104 contains a single selectable menu item, "options." If the 
user touches down with the pointing device (e.g., stylus, finger, etc.) on the "options" 
menu item, a pulldown menu will appear to allow him to select one of many available 
options (column 6, lines 23-27), the attribute comprising at least one of the scrolling 
operator, a toolbar icon and a hyperlink, and the two separate command of the window 
(100) of Figure 3 being the active area (the action bar 104) and the non-active area 
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being the touchdown file command Fig. 3 (108) comprising instructions to cause the 
electronic device to: 

the touch sensor Fig.1 (16) generates a series of interrupts to a device driver for 
the touch workpad at 1 10 which passes a set of input signals to the AUI corresponding 
to the set of points in the circle at 1 12 (column 7, lines 44-47) wherein the touch sensor 
16 is not active because it is not an icon. (See Fig.4); 

the stroke is sent to a character recognition unit or gesture recognition unit for 
processing at 128 (column 7, lines 65-67)) wherein a character recognition unit is 
included in the Advanced User interface (AUI) which stores defined character so that 
the received input from the touch sensor Fig.1 (16) can be compared to. (See Fig.4); 
and 

If the input stroke has been recognized by the gesture recognition unit as a circle 
gesture, the AUI passes the circle gesture signal to the appropriate computer module 
132 (column 8, lines 3-6). (See Fig.4). The prior art does not specifically teach execute 
the separate computer command only if the received input matches the stored 
command character and a toolbar icon. However, the prior art teaches if the input stroke 
has been recognized by the gesture recognition unit as a circle gesture, the AUI passes 
the circle gesture signal to the appropriate computer module 132 (column 8, lines 3-6)) 
wherein the input stroke being the displaying software program and the AUI passes the 
circle gesture to the appropriate computer module 132 being the second computer 
command and the action bar (104) being a toolbar icon. The displaying software 
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program being the input gesture commands and the separate computer command being 
the mouse commands. 

Thus, it would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to modify If the input stroke has been recognized by the 
gesture recognition unit as a circle gesture, the AUI passes the circle gesture signal to 
the appropriate computer module 132 (column 8, lines 3-6)) wherein the input stroke 
being the displaying software program and the AUI passes the circle gesture to the 
appropriate computer module 132 being the separate computer command and the 
action bar (104) being a toolbar icon to obtain execute the separate computer command 
only if the received input matches the stored command character and a toolbar icon 
because this would to reduce the overhead associated with a delay timer which is reset 
each time an input signal (column 2, lines 61-63). 

Regarding claim 2, Zetts teaches the mouse commands (action bar menu or 
options, Fig.3 (104)), said submenu comprising a plurality of shortcut links each to a 
different executable command (wherein the action bar menu or options (104) when 
touched with a pointing device by the user, a pulldown menu will appear to allow the 
user to select one of the plurality of available options or shortcut links (column 6, lines 
23-27). 

Regarding claim 3, Zetts teaches each of said executable commands are 
commands that operate on said graphical image (work space area Fig.3 (102) wherein 
all the commands are operated. 

Regarding claim 4, Zetts teaches the input comprises a touchdown point 
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(touchdown, Fig.3) and a series of substantially contiguous and continuous input points 
along said touch sensitive user interface that defines a character input (file command, 
Fig.3 (108)) wherein all the commands are taking place on the touch overlay Fig.1 (16). 

Regarding claim 5, Zetts teaches comparing said received character input to a 
stored command character comprises comparing a shape and a position of a 
touchdown point relative to said shape of the received character input to a shape and 
initial point of said command character (the stroke is sent to a character recognition unit 
or gesture recognition unit for processing at 128 (column 7, lines 65-67)), and wherein 
the character input matches the stored command character when said shapes match 
and the position of the touchdown point relative to the shape matches said initial point 
(a computer module within the stylus or finger-based operating system extension (AUI) 
to differentiate between touch input signals intended to emulate a mouse command, 
such as a mouse button down, mouse move, or a mouse button up, and those touch 
input signals which are to be considered a gesture or character (column 6, lines 49-55)) 
wherein as shown in Fig.3, the shape is formed by a plurality of points wherein each 
point has a position. 

Regarding claim 6, Zetts teaches comparing said received character input to a 
stored command character (the stroke is sent to a character recognition unit or gesture 
recognition unit for processing at 128 (column 7, lines 65-67)) comprises comparing a 
shape and a direction of substantially contiguous and continuous input points of the 
received character input to a shape of said command character and a direction of 
formation associated with said command character, and wherein the character input 



Application/Control Number: 1 0/830. 1 92 Page 6 

Art Unit: 2629 

matches the stored command character when said shapes match and the direction of 
substantially contiguous and continuous input points matches the direction of formation 
associated with the command character (a computer module within the stylus or finger- 
based operating system extension (AUI) to differentiate between touch input signals 
intended to emulate a mouse command, such as a mouse button down, mouse move, 
or a mouse button up, and those touch input signals which are to be considered a 
gesture or character (column 6, lines 49-55)) wherein as shown in Fig. 3, the shape is 
formed by a plurality of points wherein each point has a position. 

Regarding claim 7, Zetts teaches in response to receiving the touchdown point 
at a portion of the touch sensitive user interface that is not recognized as active by the 
display program (the touchdown to the continuous points 12 (Fig. 3)) which are 
command received by the touch overlay from a user), the improvement further 
comprises computer instructions for rendering the entire touch sensitive user interface 
as inactive to the display program until the input is terminated (the command from point 
12 to point 35 ceased where a timeout was created. Since the user interface was 
inactive, an application command, such as a "file" command 108, could be activated by 
recognizing the series of points as a "file" command generated by a mouse-pointing 
device and sent to the application program (column 6, lines 42-48)). 

Regarding claim 8, Zetts teaches the input is terminated at least when the series 
of contiguous and continuous input points ceases to be continuous for a minimum 
threshold of time (if the user stops moving the pointing device at a desired position for 
200 milliseconds, a mouse command, such as a mouse down button command, at the 
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desired position is communicated to the application program (column 7, lines 2-6)). 

Regarding claim 9, Zetts teaches the input is terminated at least when the series 
of contiguous and continuous input points ceases to move among distinct contiguous 
portions of the touch sensitive user interface for a minimum threshold of time (if the user 
stops moving the pointing device at a desired position for 200 milliseconds, a mouse 
command, such as a mouse down button command, at the desired position is 
communicated to the application program (column 7, lines 2-6)). 

Regarding claim 10, Zetts teaches the input is terminated at least when the 
series of contiguous and continuous input points match the stored command character 
(If, however, the pointing device is not moved within a period that exceeds the time 
delay, a mouse command is recognized and generated at 130 9column 7, lines 61-63)). 

Regarding claim 11, Zetts teaches the separate computer command is a 
computer command executed by a second mouse button when said displaying software 
program is embodied to receive an input from a mouse having a first and second button 
(a timeout was created and program execution transferred to mouse emulation mode. 
Now an application command, such as a "file" command 108, could be activated by 
recognizing the series of points as a "file" command generated by a mouse-pointing 
device and sent to the application program (column 6, lines 42-48)) wherein the 
separate computer command is stored in the AUI (advanced user interface) and 
wherein (a computer module within the stylus or finger-based operating system 
extension (AUI) to differentiate between touch input signals intended to emulate a 
mouse command, such as a mouse button down, mouse move, or a mouse button up, 
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and those touch input signals which are to be considered a gesture or character 
(column 6, lines 49-55) ad the mouse pointing device inherently has first and second 
buttons. 

Regarding claim 13, Zetts teaches an opened software application window Fig. 3 
(100) and the action bar 104 contains a single selectable menu item, "options." If the 
user touches down with the pointing device (e.g., stylus, finger, etc.) on the "options" 
menu item, a pulldown menu will appear to allow him to select one of many available 
options (column 6, lines 23-27), the attribute comprising at least one of the scrolling 
operator, a toolbar icon and a hyperlink, and the two separate command of the window 
(100) of Figure 3 being the active area (the action bar 104) and the non-active area 
being the touchdown file command Fig.3 (108); 

the touch sensor 16 generates a series of interrupts to a device driver for the 
touch workpad at 1 10 which passes a set of input signals to the AUI corresponding to 
the set of points in the circle at 1 12 (column 7, lines 44-47)) wherein the touch sensor 
16 is not active because it is not an icon. (See Fig.4); 

the stroke is sent to a character recognition unit or gesture recognition unit for 
processing at 128 (column 7, lines 65-67)) wherein a character recognition unit is 
included in the Advanced User interface (AUI) which stores defined character so that 
the received input from the touch sensor Fig.1 (16) can be compared to. (See Fig.4); 
and 

If the input stroke has been recognized by the gesture recognition unit as a circle 
gesture, the AUI passes the circle gesture signal to the appropriate computer module 
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132 (column 8, lines 3-6). (See Fig.4). The prior art does not specifically teach execute 
the separate computer command only if the received input matches the stored 
command character and a toolbar icon. However, the prior art teaches if the input stroke 
has been recognized by the gesture recognition unit as a circle gesture, the AUI passes 
the circle gesture signal to the appropriate computer module 132 (column 8, lines 3-6)) 
wherein the input stroke being the displaying software program and the AUI passes the 
circle gesture to the appropriate computer module 132 being the second computer 
command and the action bar (104) being a toolbar icon. The displaying software 
program being the input gesture commands and the separate computer command being 
the mouse commands. 

Thus, it would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to modify If the input stroke has been recognized by the 
gesture recognition unit as a circle gesture, the AUI passes the circle gesture signal to 
the appropriate computer module 132 (column 8, lines 3-6)) wherein the input stroke 
being the displaying software program and the AUI passes the circle gesture to the 
appropriate computer module 132 being the separate computer command and the 
action bar (104) being a toolbar icon to obtain execute the separate computer command 
only if the received input matches the stored command character and a toolbar icon 
because this would to reduce the overhead associated with a delay timer which is reset 
each time an input signal (column 2, lines 61-63). 

Regarding claim 14, Zetts teaches said separate corresponding computer 
command is to display a submenu at the touch sensitive display (action bar menu or 
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options, Fig.3 (104)), said submenu comprising a plurality of shortcut links each to a 
different executable command (wherein the action bar menu or options (104) when 
touched with a pointing device by the user, a pulldown menu will appear to allow the 
user to select one of the plurality of available options or shortcut links (column 6, lines 
23-27). 

Regarding claim 15, Zetts teaches each of said executable commands is a 
command that operates on said computer generated graphical image (work space area 
Fig.3 (102) wherein all the commands are operated. 

Regarding claim 16, Zetts teaches the input character comprises a touchdown 
point (touchdown, Fig.3) and a series of substantially contiguous and continuous input 
points along said touch sensitive user interface (file command, Fig.3 (108)) wherein all 
the commands are taking place on the touch overlay Fig.1 (16). 

Regarding claim 17, Zetts teaches comparing said input character to a stored 
command character comprises comparing a shape and a position of a touchdown point 
relative to said shape of the character input to a shape and initial point of said command 
character (the stroke is sent to a character recognition unit or gesture recognition unit 
for processing at 128 (column 7, lines 65-67)), and wherein the Input character matches 
the stored command character when said shapes match and the position of the 
touchdown point relative to the shape matches said initial point (a computer module 
within the stylus or finger-based operating system extension (AUI) to differentiate 
between touch input signals intended to emulate a mouse command, such as a mouse 
button down, mouse move, or a mouse button up, and those touch input signals which 
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are to be considered a gesture or character (column 6, lines 49-55)) wherein as shown 
in Fig. 3, the shape is formed by a plurality of points wherein each point has a position. 

Regarding claim 18, Zetts teaches comparing said input character to a stored 
command character (the stroke is sent to a character recognition unit or gesture 
recognition unit for processing at 128 (column 7, lines 65-67))comprises comparing a 
shape and a direction of substantially contiguous and continuous input points of the 
received character input to a shape of said command character and a direction of 
formation associated with said command character, and wherein the input character 
matches the stored command character when said shapes match and the direction of 
substantially contiguous and continuous input points matches the direction of formation 
associated with the command character(a computer module within the stylus or finger- 
based operating system extension (AUI) to differentiate between touch input signals 
intended to emulate a mouse command, such as a mouse button down, mouse move, 
or a mouse button up, and those touch input signals which are to be considered a 
gesture or character (column 6, lines 49-55)) wherein as shown in Fig. 3, the shape is 
formed by a plurality of points wherein each point has a position. 

Regarding claim 19, Zetts teaches in response to receiving the touchdown point 
at a portion of the touch sensitive user interface that is not recognized as active by the 
display program (the touchdown to the continuous points 12 (Fig. 3)) which are 
command received by the touch overlay from a user), the improvement further 
comprises computer instructions for rendering the entire touch sensitive user interface 
as inactive to the display program until the input character is tenninated (the command 
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from point 12 to point 35 ceased where a timeout was created. Since the user interface 
was inactive, an application command, such as a "file" command 108, could be 
activated by recognizing the series of points as a "file" command generated by a 
mouse-pointing device and sent to the application program (column 6, lines 42-48)). 

Regarding claim 20, Zetts teaches the separate corresponding computer 
command is a computer command executed by a second mouse button when said 
displaying software program is embodied to receive an input from a mouse having a first 
and second button(a timeout was created and program execution transferred to mouse 
emulation mode. Now an application command, such as a "file" command 108, could be 
activated by recognizing the series of points as a "file" command generated by a 
mouse-pointing device and sent to the application program (column 6, lines 42-48)) 
wherein the separate computer command is stored in the AUI (advanced user interface) 
and wherein (a computer module within the stylus or finger-based operating system 
extension (AUI) to differentiate between touch input signals intended to emulate a 
mouse command, such as a mouse button down, mouse move, or a mouse button up, 
and those touch input signals which are to be considered a gesture or character 
(column 6, lines 49-55) ad the mouse pointing device inherently has first and second 
buttons. 

Regarding claim 21 , Zetts teaches a portable electronic device (a flat panel 
display to form what is known as a "touch workpad" (column 3, lines 67 and 68)) 
wherein a flat panel display is light or portable comprising: 

a touch sensitive display (work space area Fig. 3 (102)); 
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an opened software application window Fig.3 (100) and the action bar 104 
contains a single selectable menu item, "options." If the user touches down with the 
pointing device (e.g., stylus, finger, etc.) on the "options" menu item, a pulldown menu 
will appear to allow him to select one of many available options (column 6, lines 23-27), 
the attribute comprising at least one of the scrolling operator, a toolbar icon and a 
hyperlink, and the two separate command of the window (100) of Figure 3 being the 
active area (the action bar 104) and the non-active area being the touchdown file 
command Fig.3 (108); 

AUI is stored in RAM 80 with the operating system 81 and application programs 
82 (column 6, lines 13 and 14); and 

the touch sensor 16 generates a series of interrupts to a device driver for the 
touch workpad at 1 10 which passes a set of input signals to the AUI corresponding to 
the set of points in the circle at 1 12 (column 7, lines 44-47)) wherein the touch sensor 
16 is not active because it is not an icon. (See Fig.4); 

the stroke is sent to a character recognition unit or gesture recognition unit for 
processing at 128 (column 7, lines 65-67)) wherein a character recognition unit is 
included in the Advanced User interface (AUI) which stores defined character so that 
the received input from the touch sensor Fig.1 (16) can be compared to. (See Fig.4); 
and 

If the input stroke has been recognized by the gesture recognition unit as a circle 
gesture, the AUI passes the circle gesture signal to the appropriate computer module 
132 (column 8, lines 3-6). (See Fig.4). The prior art does not specifically teach execute 
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the separate computer command only if the received input matches the stored 
command character and a toolbar icon. However, the prior art teaches if the input stroke 
has been recognized by the gesture recognition unit as a circle gesture, the AUI passes 
the circle gesture signal to the appropriate computer module 132 (column 8, lines 3-6)) 
wherein the input stroke being the displaying software program and the AUI passes the 
circle gesture to the appropriate computer module 132 being the second computer 
command and the action bar (104) being a toolbar icon. The displaying software 
program being the input gesture commands and the separate computer command being 
the mouse commands. 

Thus, it would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to modify If the input stroke has been recognized by the 
gesture recognition unit as a circle gesture, the AUI passes the circle gesture signal to 
the appropriate computer module 132 (column 8, lines 3-6)) wherein the input stroke 
being the displaying software program and the AUI passes the circle gesture to the 
appropriate computer module 132 being the separate computer command and the 
action bar (104) being a toolbar icon to obtain execute the separate computer command 
only if the received input matches the stored command character and a toolbar icon 
because this would to reduce the overhead associated with a delay timer which is reset 
each time an input signal (column 2, lines 61-63). 

Regarding claim 28, Zetts teaches FIG. 3 is a representation of the touch 
workpad of FIG. 1 showing an opened software application window 100 column 6, lines 
18-20); 
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an opened software application window Fig.3 (100) and tlie action bar 104 
contains a single selectable menu item, "options." If the user touches down with the 
pointing device (e.g., stylus, finger, etc.) on the "options" menu item, a pulldown menu 
will appear to allow him to select one of many available options (column 6, lines 23-27), 
the attribute comprising at least one of the scrolling operator, a toolbar Icon and a 
hyperlink, and the two separate command of the window (100) of Figure 3 being the 
active area (the action bar 104) and the non-active area being the touchdown file 
command Fig.3 (108); 

AUI is stored in RAM 80 with the operating system 81 and application programs 
82 (column 6, lines 13 and 14); 

the touch sensor 16 generates a series of interrupts to a device driver for 
the touch workpad at 110 which passes a set of input signals to the AUI corresponding 
to the set of points in the circle at 1 12 (column 7, lines 44-47)) wherein the touch sensor 
16 Is not active because It is not an icon. (See Fig.4); 

the stroke is sent to a character recognition unit or gesture recognition unit for 
processing at 128 (column 7, lines 65-67)) wherein a character recognition unit Is 
included in the Advanced User interface (AUI) which stores defined character so that 
the received Input from the touch sensor Fig.1 (16) can be compared to. (See Flg.4); 
and 

If the Input stroke has been recognized by the gesture recognition unit as a circle 
gesture, the AUI passes the circle gesture signal to the appropriate computer module 
132 (column 8, lines 3-6). (See Flg.4). The prior art does not specifically teach execute 
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the separate computer command only if the received input matches the stored 
command character and a toolbar icon. However, the prior art teaches if the input stroke 
has been recognized by the gesture recognition unit as a circle gesture, the AUI passes 
the circle gesture signal to the appropriate computer module 132 (column 8, lines 3-6)) 
wherein the input stroke being the displaying software program and the AUI passes the 
circle gesture to the appropriate computer module 132 being the second computer 
command and the action bar (104) being a toolbar icon. The displaying software 
program being the input gesture commands and the separate computer command being 
the mouse commands. 

Thus, it would have been obvious to a person of ordinary skill in the art at the 
time the invention was made to modify If the input stroke has been recognized by the 
gesture recognition unit as a circle gesture, the AUI passes the circle gesture signal to 
the appropriate computer module 132 (column 8, lines 3-6)) wherein the input stroke 
being the displaying software program and the AUI passes the circle gesture to the 
appropriate computer module 132 being the separate computer command and the 
action bar (104) being a toolbar icon to obtain execute the separate computer command 
only if the received input matches the stored command character and a toolbar icon 
because this would to reduce the overhead associated with a delay timer which is reset 
each time an input signal (column 2, lines 61-63). 

Regarding claim 29, Zetts teaches FIG. 3 is a representation of the touch 
workpad of FIG. 1 showing an opened software application window 100 column 6, lines 
18-20); 
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AUI is stored in RAM 80 with the operating system 81 and application programs 
82 (column 6, lines 13 and 14); 

the separate computer command means is being the mouse commands when 
the user touches down with the pointing device (e.g., stylus, finger, etc.) on the " 
options " menu item, a pulldown menu will appear to allow him to select one of many 
available options , (column 6, lines 24-27) and the command s are embodied in the 
application programs 82 which is part of the AUI; and 

the embodied computer means being the AUI (column 6, lines 13 and 14); 

Regarding claim 30, Zetts teaches the action bar 104 contains a single selectable 
menu item, " options " represents the separate computer command. 

4. Claims 12 and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over U.S. Patent No. 5,404,458 (Zetts) in view of US Patent No. 5,537,608 (Beatty et 
al.). 

Regarding claim 12 and 22, Zetts teaches all the claimed limitations with the 
exception of providing a mobile station. 

However, Beatty et al. teach personal communicator 10 integrates the 
architecture of a complete personal computer with a modem and an RF transceiver into 
a portable, lightweight package which fits in the user's hand or pocket (column 3, lines 
61-64). 

Thus, it would obvious to a person of ordinary skill in the art at the time the 
invention was made to utilize the personal communicator as taught by Beatty et al. in 
the touch workpad disclosed by Zetts because this would provide a radio frequency 
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communication. 

Conclusion 

5. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry conceming this communication or earlier communications from the 
examiner should be directed to Jean Lesperance whose telephone number is (571) 
272-7692. The examiner can normally be reached on from Monday to Friday between 
10:OOAM and 6:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richard Hjerpe, can be reached on (571) 272-7691. 

Any response to this action should be mailed to: 
Commissioner of Patents and Trademarks 
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Washington, D.C. 20231 



or faxed to: 



(571) 273-8300 (for Technology Center 2600 only) 



Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 
Jean Lesperance 
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